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ABSTRACT 


Group development is the first and most important step for the success 
of collaborative problem solving (CPS) learning in the digital learning 
environment (DLE). A literacy study is needed for studies in the intelligent 
agent domain for group development of collaborative learning in DLE. 
This paper is a systematic literature review (SLR) of intelligent agents for 
group formation from 2001 to 2019. This paper aims to find answers to 4 
(four) research questions, namely: 1) What components to develop intelligent 
agents for group development; 2) What is the intelligent agent model for 
group development; 3) How are the metrics for measuring intelligent agent 
performance; and 4) How is the Framework for developing intelligent agent. 
The components of the intelligent agent model consist of: member attributes, 
group attributes (group constraints), and intelligent techniques. This research 
refers to Srba and Bielikova's group development model. The stages 
of the model are formation, performing and closing. An intelligent agent 
model at the formation stage. A performance metric for the intelligent agent 


at the performance stage. The framework for developing an intelligent agent 
is a reference to the stages of development, component selection techniques, 
and performance measurement of an intelligent agent. 
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1. INTRODUCTION 

Collaborative problem solving (CPS) learning based on a digital learning environment (DLE) 
is an effort to realize 21“ century skills [1-5]. Group development is the first and most important step for 
the success of CPS learning in DLE [6-10]. A literacy study is needed for studies in the intelligent agent 
domain for group development of collaborative learning in DLE. This paper is a systematic literature review 
(SLR) of intelligent agents for group formation from 2001 to 2019. Source articles from ACM Digital 
Library, Science Direct, Springer Link, IEEE Xplore Digital Library, ProQuest, and EBSCOhost. 
The research objectives are represented in 4 research questions and the outcomes in Table 1 below. 
The answers to the 4 research questions above are based on the results of the processing and analysis 
of 26 SLR papers. 

The intelligent agent component map consists of member attributes, group attributes, and intelligent 
techniques [7-9, 11-14]. The member attribute component represents the problem of the group member 
population. Components of group attribute (constraint group formation) are methods, constraints, and rules 
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for group development [15]. The component of engineering intelligence represents intelligent technology to 
increase efficiency and effectiveness in group development [13, 16-18]. 


Table 1. Research question and outcome 


Research question (RQ) Outcome 

RQ1 What components are there for developing Map of intelligent agent components for group 
intelligent agents for group development on development on DLE. 
DLE? 

RQ2 Development of an intelligent agent model at The intelligent agent model at the group 
the group development stage? development stage 

RQ3 What are the intelligent agent performance Intelligent agent performance metrics for group 
metrics at the group development stage? development on DLE 

RQ4 What is the intelligent agent development An intelligent agent development framework 
framework for group development on DLE? for group development on DLE. 


Classification of group development models based on DLE are Long-term virtual groups 
and Sort-term virtual groups. Long-term virtual groups begin with Tuckman's model (1965), Tuckman 
and Jensen's model (1977) [19], and Daradoumis et al.'s model (2002) [20, 21]. Tuckman's model 
is a reference for Long-term virtual groups. This model proved successful for the development of long-term 
learning groups (for example [22]), but was not very suitable for the development of learning groups on 
DLE. The characteristics of this model are to build strong relationships between group members, long term, 
and depend on collaborative planning. 

Sort-term virtual group starts with Srba and Bielikova's model (2014) [8]. This model is for 
short-term groups (usually in hours). The life cycle of the model is simpler than the Long-term virtual 
groups. Srba and Bielikova's model (2014) in Figure 1 consists of three stages: formation, performing, 
and closing [8]. The formation stage is the stage for group formation. Performing stage is a measure 
of the effectiveness of collaborative learning processes (collaboration performance) [23, 24]. And closing 
stage is a review and evaluation process of groups that have was made. There has been no discussion 
of the framework for implementing intelligent agents at each stage of the model. 


Performing Closing 








Figure 1. Srba and Bielikova’s group formation model [8] 


An intelligent agent for the development of study groups on DLE 1s classified as a virtual short-term 
model. This research refers to Srba&Bielikova’s group development model [8], in Figure 1. The intelligent 
agent model is implemented at the formation stage. The intelligent agent model consists of 3 
(three) components, namely: member attributes, group attribute (constrain of group formation), 
and intelligent technique [7-9, 11-14]. Performance metrics for the intelligent agent at the performance stage. 
Performance metrics consist of 5 (five) measurements [23, 24] namely group formation time; optimization 
of the distribution of members in groups; Collaboration performance (CO); Knowledge; and skills. 

The intelligent agent development framework is a reference to the stages of development, 
component selection techniques, and performance measurement of intelligent agents. The development 
framework consists of 5 stages, namely: 1) Understanding the problems and goals of group development; 
2) Determining components for intelligent agents; 3) Development of intelligent agent software; 
4) Implementation and testing, and 5) Evaluation of intelligent agents. 

A detailed discussion of component mapping, intelligent agent models, performance metrics, 
and a framework for developing intelligent agents is discussed in chapter 3 (result and analysis). The 
mapping of intelligent agent components is the answer to RQ1, discussed in chapter 3.1. The intelligent agent 
model is the answer to RQ2, discussed in chapter 3.2. The intelligent performance metrics are the answer to 
RQ3, discussed in chapter 3.2. and The intelligent agent development framework is the answer to RQ4, 
discussed in chapter 3.3. 
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2. RESEARCH METHOD 
The research methodology aims to find answers to 4 (four) research questions. The research 

methodology consists of 4 stages, as follows: 

1) Search for SLR articles based on research questions in Table | 

2) Related searches on intelligent agent domains for the development of collaborative learning groups 
in DLE 

3) A correspondent with experts in the domain of intelligent agent development for group development. 
The paper collection is based on a search strategy based on 3 keywords and their synonyms in Table 2. 
Paper searches based on Category 1, Category 2, and Category 3 keywords are combined by Boolean 
AND (&) operators, and for each keyword synonym for each category use the OR (II) Boolean operator 

4) Analyze search results for mapping intelligent agent components, developing intelligent agent models, 
performance metrics, and frameworks for developing intelligent agents 


Table 2. Categories of keywords and their synonyms 


Category and synonyms Search string 

Group formation (Category 1). Synonyms: (Group formation Il group development Il group 
(group formation, group development, group creation, creation Il group design Il group composition Il 
group design, group composition, team formation, team formation, team development Il team 
team development, team creation, team design, creation ll team design Il team composition) 
team composition). & 

Collaborative learning (Category 2). Synonyms: (Collaborative learning || collaborative problem 
(collaborative learning, collaborative problem solving, solving Il csgf Il cscl ll group learning II team 
csef, cscl, group learning, team learning) learning) 

Intelligent (Category 3). Synonyms: & 

(intelligent, smart, adaptive, algorithms, methods, (Intelligent I| smart Il adaptive II algorithms II 
technique) methods II technique). 


3. RESULTS AND DISCUSSION 

This chapter discusses the mapping of intelligent agent components, intelligent agent models, 
performance metrics, and the framework for developing intelligent agents. The mapping of intelligent agent 
components is discussed in chapter 3.1, the intelligent agent model is discussed in chapter 3.2, performance 
metrics are discussed in chapter 3.2, and the framework for developing intelligent agents is discussed 
in chapter 3.3. 


3.1. Intelligent agent component mapping 

The SLR results of intelligent agent research for group development from 2001 to 2019 
are illustrated in Table 3. Search results included 111 articles from the ACM Digital Library, 170 articles 
from Science Direct, 387 articles from Springer Link, 318 articles from IEEE Xplore Digital Library, 
312 articles from ProQuest, and 311 articles from EBSCOhost. There are 26 papers that are relevant 
for mapping intelligent agent components. The mapping of intelligent agent components is based on 
the column mapping in table 3. Component maps include member attributes, group attributes, and intelligent 
techniques [7-9, 11-14]. 

The member attribute component represents the problem of the population of group members 
and the purpose of group development. Components of group attribute/(constraint group formation) 
are methods, constraints, and rules for group development [15]. The intelligent technique component 
represents intelligent technology to increase efficiency and effectiveness in group development [13, 16-18]. 

The population of Member attribute components consists of 4 articles of knowledge competence, 
6 articles of learning style, 3 articles of social interaction, 3 articles of team roles, 4 articles of personal traits, 
and 14 articles of various attributes. Table 3 shows many alternative methods of group formation, and each 
alternative method has advantages and disadvantages. Each method refers to the problem of the population 
of group members and the purpose of group development [9]. 

The intelligent technique component for group development consists of 18 different algorithms. 
The algorithm most widely used in group development is the genetic algorithm. The level of intelligence 
utilizing intelligent technology includes: 1) automatic level, 2) smart level, and 3) intelligent level. Automatic 
Level is an attempt to automate the process of group formation. Smart level is a higher level than automatic 
level. At this level machines have started the process of decision making, and there is still an element 


An intelligent agent model for learning group development... (Budi Laksono Putro) 


1162 O ISSN: 2302-9285 


of human intervention. The intelligent level is the highest level. The decision making process is completely 
taken over by the machine. 


Table 3. SLR of intelligent agent research for group development from 2001 to 2019 


No Ref Se r r ae Group attribute (constrain group formation) 

1 [25] y D and E Data mining methods: clustering learning style. 

2 [26] Various G AHC method, which is known as SLG. 

3 [27] Various D Dynamically forming groups on the MCSCL system 

4 [28] Various A The inversion method to determine the representation 
of dominant attributes in group members. 

5 [29] Various A Comparison between intra-heterogeneous and Inter- 
homogeneous groups with 3 different algorithms. 

6 [30] Various A Formulate various group goals based on various 
problems forming groups. Method by comparing 3 
algorithms (exhaustive, proposed method, and 
random) 

7 [31] Various K Formation of groups based on attributes desired by 
teachers. 

8 [32] Informal data K Automatic group formation model. Using data 
mining methods, namely: unification, mining, and 
drawing conclusions. 

9 [33] Thinking styles K Apply the psychological attributes of students. 

10 [34] Various F Minimize the time taken by the teacher to create 
groups 

11 [35] | Programming styles K Use attribute programming style for group formation. 

12 [36] Empty slot attribute C Use the empty slot method in group formation. 

13 [37] Dynamic attribute O Method of forming groups dynamically on a web 
learning system. 

14 [88] Characteristics & O Group formation pays attention to individual learning 

functions of learner patterns and collaborative learning. 

15 [39] Various O Formation of groups based on rules and policies in 
the I-MINDS system. 

16 [40] X y V B Heterogeneous groups method, by comparing 3 
different algorithms. 

17 [M] X y A,C Methods for forming heterogeneous, homogeneous, 
and mixed groups. 

18 [42] X y y V A Formation of groups is based on collecting attributes 
from OSN 

19 [43] X y y V B The method of utilizing the student feature model 
becomes the attribute model. 

20 [44] X y y E Homogeneous and heterogeneous group formation 
methods are based on the number of groups the 
instructors want. 

21 [45] X V O Formation of a balanced group using the evolution 
algorithm, based on the role of members 
automatically. 

22 [46] X y O Belbin's team role method, by way of agreement with 
the team role. 

23 [47] X V y V R The framework for group formation is based on 
teacher preferences. 

24 [48] X y y K Method of measuring heterogeneous groups. 

25 [22] X y R Formation of groups based on continuous 
improvement of rules. 

26 [49] Various Computer-aided group formation. 

26 14 4 6 3 3 4 18 variety 
Note. 


MAK = Member Attribute - Knowledge Competance. MAL = Member Attribute - Learning Style. MAS = Member Attribute - Social 
Interaction. MAT = Member Attribute - Team Role. MAR = Member Attribute - Personal Traits. 

A : Genetic algorithm (5), B: Particle swarm optimization (3), C:Greedy algorithm (2), D: K-means (2), E: Fuzzy C-Means (FCM) (2), 
F: Rule-based system (1), G: agglomerative hierarchical clustering (AHC) (1), H: Ant Colony algorithm (1), I: Tabu search (1), J: Mash- 
up Technique (1), K: Random Mutation Hill Climbing (1), L: Quality metrics of Software (1), M: Integration base on Ontology (1), N: 
Means End Analysis (1), O: Multi-agents (2), P: Knowledge base evolutionary algorithm (1), Q: Semantic Web Ontologies (1), R: 
Regression analysis optimization (1). 


3.2. Intelligent agent model 

The intelligent agent model is developed based on the intelligent agent component map. 
The intelligent agent model consists of 3 (three) components, namely: member attributes, group attributes, 
and intelligent technique. The intelligent agent model is illustrated in Figure 2. The intelligent agent model 
is at the formation stage of the Srba and Bielikova’s group development model [8]. This model aims to find 
the most optimal components for developing intelligent agent software for group development. 
The performance of intelligent agent software for group development is measured at the performing stage. 
Evaluation and improvement of intelligent agent software are carried out at the closing stage. 
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Figure 2. An intelligent agent model at the stage of the Srba and Bielikova’s group development model [8] 


The performance of intelligent agents is measured at the Performing stage. Metrics for measuring 
intelligent agent performance are described in Table 4. Intelligent performance metrics are based on 5 (five) 
measuring tools namely [23, 24]: Group formation time, optimizing the distribution of members in groups, 
Collaboration performance (CO), Knowledge, and skill. 


Table 4. Metrics Performance of intelligent agent 


Metrix Performance [23, 24] Measurement Student Group Class 
Formation 01 Group formation time Efficiency time y y 
stage 02 Optimizing the distribution of members Percentage distribusi siswa V y 

in groups 

Performing 03 Collaboration performance (CO) Peer group member assessment y y y 
stage questionnaire. 

04 Knowledge Pre-Test & Post-Test V al V 

05 Skills Project Task y y y 


3.3. An intelligent agent development framework 


The intelligent agent development framework is a reference to the stages of intelligent agent 


development, and the most appropriate component selection technique. The intelligent agent development 
framework is illustrated in Figure 3 below. The intelligent agent development framework consists of 5 stages, 
as follows: 


L. 


Understanding the problems and goals of group development. The initial step is understanding 
the problem of the existing group member population. The goal is the best hypothesis for several 
solutions to solve the problem. The output of this stage is defining the problem and setting goals for 
developing an intelligent agent software. 

Determining components for intelligent agents. Understanding the problem and the goal of developing 


intelligent greatly influences the quality of the selection of intelligent components. The intelligent 
component map is depicted in table 3, which consists of member attributes, group attributes, and 
intelligent technique. The output of this stage is the selection of components for intelligent agents. 


Development of intelligent agent software. This stage is the implementation of stages 1 and 2 
into an intelligent agent software. The output of this stage is an intelligent agent software for 
group development. 


. Implementation and testing. Implementation and testing of intelligent agent software on research objects 


for group development. The output of this stage is the data from the implementation and testing 
of intelligent agent software. 


. Evaluation of intelligent agents. Evaluation is the result of the analysis of the implementation and testing 


data at the 4th stage. The output of this stage is the improvement of intelligent agent software for 
group development. 
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Figure 3. Framework for developing intelligent agents for group formation 


The framework in Figure 3 is made for reference to the development of intelligent agents for group 
development. Many alternative methods for developing intelligent agents and each alternative development 
method has advantages and disadvantages [50]. This study summarizes 26 different intelligent agents 
(Table 3) for group development with problems and the application of each method. The method 
of developing intelligent agents is influenced by the problems of the member population, the purpose 
of group development, the selection of component attributes of intelligent, and measuring the effectiveness 
of intelligent agents. Each population group has special problem characteristics. Understanding group 
member population problems is an initial, important, and influential step to the success of the next stage. 
The choice of intelligent component attributes is strongly influenced by the characteristics of the group 
population problem and the purpose of group development. The choice of measuring the effectiveness 
of an intelligent agent is also strongly influenced by the previous stages. The development of intelligent 
agents is still open for further research. Intelligent testing also still requires more effective measurement 
methods and a wider population. 


4. CONCLUSION 

An intelligent agent for the development of study groups on DLE is classified as a virtual short-term 
model. This research refers to Srba and Bielikova’s group development model. The stages of the model 
are formation, performing, and closing. The intelligent agent model is implemented at the formation stage. 
Performance metrics are performed at the performance stage. Evaluation of intelligent agents is carried out at 
the closing stage. The intelligent agent model consists of 3 components, namely member attribute, group 
attribute (constrain group formation), and an intelligent technique. Performance metrics for intelligent agents 
consist of 5 (five) measuring instruments, namely group formation time; optimization of the distribution 
of members in groups; Collaboration performance (CO); Knowledge; and skills. The framework for 
implementing intelligent agents is a reference to the stages of development, component selection techniques, 
and performance measurement of intelligent agents. Research on the intelligent agent domain still 
has opportunities to be developed. The results of this study are expected to be intelligent development 
references for group development. 
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